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, ' - 1 - DUPLICATE 

IMPROVED COMPOSITE DECODING 

This invention concerns the decoding of composite colour television signals to colonr 
components. 

Composite colour television systems, such as NTSC and PAL are designed so that the 
S 22 chrominance components of the ^^^T^ZS^Z 
3vet be separated with acceptable levels of crosstalk. Use of the composite signal 
for tolay Always requires it to be separated (decoded) mto primary colour 
component (red, green and blue); many other processing operations require at least 
theTep^on of't£ chrominance from the luminance, and often, further decoding of 
the chrominance. 

The choice of decoding method for a particular application depends on the acceptable 
Sd SSSdk between chrominance and luminance, and the degree of distorUon £ 
Z Z^ chrominance and luminance as a result of the separation process. Where 
S^are to be displayed on large screens, or must stand comparison with images 
3 from film, the very highest level of chrominance and luminance separation is 
necessary, with negligible crosstalk and distortion. 

High quality composite decoders exploit the fact that the chrominance i^dulated 
onlo a niXspatL-frequency, moving diagonal carrier, which is unhkely to be 
^Heated by real lunifrWe. By using contributions from several lines and fieMs it is 
nSfoto create comb-filters which allocate different parts of the signal spectrum to 
Sane S cLoXnce and so achieve separation with little crosstalk on typical 
S^owevS it is frequently necessary to "adapt" the frequency characteristics 
S £ ffltSl dependence upon to type of picture material, so as to avoid crosstalk 
or distortion of critical material. 

Furonean oatent EP1175102 presents a novel method of doing this by using a fast 
FoX^fonu (FFT) to convert the signal into the frequency domain and then 
niv^aC mTsyWetry of the spectrum with respect to subcarner frequency 
Because to cLormZc? components are amplitude modulated, each Fourier 
component of the baseband chrominance results in a pair of equal-amplitude 
sXCdTsymmetrically disposed about the subcarrier frequency. By comparing each 
SequScy coZonent wk me corresponding component which would cprrespond to 
me oppose chrominance sideband, it is possible to determine whether the particular 
component represents luminance or chrominance. 

The cited patent does not explain how to apply, the technique to NTSC and is 
Srricted to applications where the signal is sampled at a multiple of to subcarner 
frequency. 

The oresent inventor has appreciated that there are a number of improvements which 
w^Z SelXSiuty of me prior art, in particular it may be applied to to decoding 
ofl^SC ceK distortions which may exist in to coded signal may be corrected 
°id^fpVoc^g marbe carried out on demodulated chrominance signals at any 

sampling rate. 

o^S to tie fluency difference of the first frequency component from the colonr 
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subcarrier, characterised in that the comparison differs in dependence upon the 
frequency of the first frequency component. 

Suitably, the comparison differs in dependence upon the horizontal spatial frequency 
of the said first frequency component 

Advantageously, the comparison differs in dependence upon the vertical spatial 
frequency of the said first frequency component 

Additionally the comparison may differ in dependence upon the temporal frequency 
of the said first frequency component 

hi a further embodiment the comparison may differ in dependence upon horizontal, 
vertical or temporal differences of a composite signal. 

Advantageously the temporal differences may be derived from the output of a 
chrominance demodulator. 

In a further aspect the invention consists of a method of separating the chrominance 
and luminance of a composite colour television signal by comparing a first frequency 
component of the signal with a second frequency component of the signal, the second 
component having a frequency difference from the colour subcarrier equal and 
opposite to the frequency difference of the first frequency component from the colour 
subcarrier, wherein the comparison is made between frequency components of 
demodulated, baseband chrominance signals. 

In a yet further aspect the invention consists of a method of correcting distortion of a 
composite colour television signal in which an upper chrominance sideband is 
identified and its amplitude corrected by making it equal to the amplitude of the 
corresponding lower chrominance sideband. 

Advantageously the corresponding lower sideband is identified in terms of its 
horizontal spatial, vertical spatial and temporal frequency co-ordinates. 

An example of the invention will now be described with reference to the drawings in 
which: 

Figure 1 shows a prior-art PAL decoder. 

Figure 2 shows the vertical/temporal spectrum of a PAL signal. 
Figure 3 shows a decoder, in accordance with an embodiment of the invention. 
Figure 4 shows a contour plot of a look-up-table function. 
Figure 5 shows the vertical/temporal spectrum of an NTS C signal. 
Figure 6 shows a composite decoder according to another aspect of the 
invention. 

Figure 7 shows a composite decoder according to yet another aspect of the 
invention. 

Figure 8 shows a luminance processing look-up-table. 
Figure 9 shows a chrominance processing look-up-table. 
Figure 10 shows a look-up-table for correcting high-frequency loss. 
Figure 1 1 shows a composite decoder according to another embodiment of the 
invention 

First a known decoder will be described to illustrate the deficiencies of the prior art. 
Referring to Figure 1, a composite PAL signal (1), which has been sampled at four 
times its colour subcarrier frequency (4f sc ) is divided (2) into three-dimensional, 
spatially-overlapping blocks; a window function is applied (3) to each block; and, a 
three-dimensional FFT is taken (4) of each block. 



A three-dimensional block means a block of spatially and temporally contiguous 
pixS takTfrom a number of consecutive fields; for exampte 16 honzonteUy- 
^acen^els - 1 6 vertically-adj acent lines on 8 consecutive fields, giving a total of 
2048 pixels. 

The result of the FFT will be (in the case of the above example) a set of 2048 
Squ^cy components defining the block of pixels in terms of horizontal spatial 
XSnS Vertical spatial frequency and temporal frequency. Each component has 
tSZ V a£^Z a phas^vani These components will be processed to remove 
tt ^to finance, so that only the components representing chrommance are 
input to the inverse FFT (10). 

The block (5) determines the magnitude of each component. The divider (6) divides 

component by its magnitude so as to normalise xt to unit amplitude. 
The comparator (8) compares the magnitude of each component ^\^magmtude 
^on^eTcomponent The other component is selected (by the block (7)) to be the 
tZon^olZ^er^onsi frequency difference from the colour subcamer 
frequent n Tequal and opposite to the component's own frequency difference from 
the colour subcarrier. 

u . nnini is mustrated in Figure 2, which shows how the selection of the 
bonding fr^"componS is made in the vertical and temporal frequency 
S? 8 A Tthe signal has been sampled vertically (by the hne structure) and 
SpoX'Cbf theVe f structure), the spectrum repeats vertically 'and ^mporally as 
The figure shows the spectral position of the colour subcarrier (f sc ) and a 
fe^nc?Lm^nerwhich is to be processed (*). The position of the component 
SffSSl aTop^osite frequency difference is shown as <w). For completeness the 
figure also shows the position of the (phase alternating) V carrier (V). 
Fieure 2 shows only the vertical and temporal dimensions; it must be noted that the 

comparison. 

Returning to Figure 1, the block (8) outputs the magnitude of the smaller of the , two 
reflected" component had smaller amplitude. 

All 9048 freauencv components in each block are processed in this way and input to 
£ Z J^llO) 'whose output is a filtered block of pixels with luminance 
frequencies attenuated. 

The result of this processing is a three-dimensional block of 2048 chrominance pixels 
wSch in the block (11). This window is chosen ^tite combination 

the window (3) gives a response which tessellates; i.e. so that when the output 
^^^(12) there iTno amplitude 

block. An example is the use of an identical cosmusoidal function for each window, 
giving a raised cosine response for the combination. 

— . . nf th . h1nc1 , (io\ is a modulated chrominance signal which can be 
^r^M^ S2££J for process delay) fron. the ccaposite *p»t 



in the block (13) to give separated lu m inance output (14), and demodulated (15) to 
give baseband U and V colour-difference outputs (16), 

Inspection of Figure 2 shows that, because of the repeating structure of the spectrum, 
there are certain frequencies which inherently mimic symmetrical, double sideband 
chrominance. One of these is the phase alternating V-axis carrier, this is fortunate as it 
is a true chrominance component. Another is the moving diagonal pattern at the 
position (a); this is identical to true subcarrier except that it moves with one third the 
speed in the opposite direction. A further example is shown at (b) and is identical to 
the V-axis carrier but moving at one third speed in the opposite direction. Both these 
patterns would give rise to coarse cross-colour when decoded according to the prior 
art. 

A further disadvantage of the prior-art approach becomes apparent when both colour 
difference signals give rise to a sideband having the same (or very similar) frequency. 
In this case the magnitude of that component will depend on the relative phase of the 
two baseband colour difference components and the expected symmetry may not 
result. This is less likely in PAL because the U and V carriers have different spatio- 
temporal frequencies. However, in NTSC, where the two colour difference signals are 
modulated onto the same carrier frequency, this situation may well result from the 
coding of coloured patterns or textures. 

An embodiment of the current invention will now be described with reference to 
Figure 3. This shows a decoder having the same structure as Figure 1, except that the 
minimum function (8) of Figure 1 has been replaced by a look-up-table (308). 

The table has inputs for the magnitude of the frequency component being processed, 
the magnitude of the corresponding component symmetrically disposed with respect 
to subcarrier and a third input, from the frequency-determining block (318), which 
defines the frequency, including in some cases all three frequency dimensions, of the 
component being processed. 

The frequency input enables certain frequencies to be treated differently, in particular, 
different frequencies within the horizontal chrominance band can be treated 
differently in dependence upon all or any of their three dimensional frequency 
components. The look-up-table can have different "pages" corresponding to different 
frequencies or frequency ranges of the component being processed. For example, the 
frequencies (a) and (b) in Figure 2 can be regarded as sources of cross-colour and 
their magnitudes heavily attenuated. 

As well as enabling frequency-dependant behaviour, the look-up-table enables an 
arbitrary function of the amplitudes of the two components to be used to decide the 
magnitude of the component to be passed to the inverse FFT (310). 

An example of a suitable function is shown in Figure 4. This figure shows a contour 
plot of the table output for various magnitudes of the frequency being processed and 
the equivalent "subcarrier reflected" frequency component. 

It can be seen that where the two components have substantially equal amplitude, the 
output corresponds to the amplitude of the component being processed. However, 
where the amplitudes are significantly different, the table output is zero. Between 
these two regions the output smoothly varies between these two values. 
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The use of a function which includes the frequency makes it feasible to decode NTSC 
W £ 'fSot considered possible in the prior art. ^ Jus case a s ^le block of 
pixels for the FFT is 1 6 pixels horizontally by 1 6 lines vertically by 4 fields. 
Figure 5 shows the vertical/temporal structure of NTSC chrominance, hi the same 
wfv^s shown in Figure 2, the frequency (x) will occur simultaneously with the 
fiSuencv O^when &is due to true chrominance. However, the frequencies which 
repeat) are inherently symmetrical about colour subcamer are 
much more troublesome than in the PAL case. 

Consider the frequency (*)• This is at the origin of the vertical/temporal plane and 
c^esponS to aVtionary pattern of fine vertical stripes It repeats 
wuh respect to subcarrier and thus, in the case of naive application of the prior art, it 
would be a potent source of fine cross-colour. 

The freauency (d) corresponds to a stationary diagonal pattern (with twice the vertical 
SueX^fLSur subcarrier) and would also be a source of cross-colour. Although 
moTp^e Purees would to pre-filtered to avoid this 

be heavily ahassed) it is undesirable for stationary detail to contribute cross-colour. 
It is therefore possible to use the decoder of Figure 3 to decode NTSC by arranging 
L Sency components close to the positions (*) and (d) in Figure 5 to be 
is done by programming the look-up-table to ^ftf£^3^ 
SLe freauencies A suitable method of generating the table contents is to train me 
Se wSdmg material for which the original un-coded RGBorYUV components 
are available, and optimising the table to minimise the errors in the decoded output. 
~ ^zter likelihood in NTSC of the same sideband frequency resulting from the 
£ b^a^^e^mponents means that the variation of the 
rTspor^e with respect to frequency will be greater than in the case of a PAL decoder. 
An example of another aspect of the invention, in which the processing is earned out 
on demodulated chrominance signals, will now be described. 

A decoder according to this aspect of the invention is shown in Figure 6. A composite 
tt^ZntZt which maybe sampled at any convenient frequency (for example 
t orfcXnal line-locked sampling frequency) is input to a simple chrormnance 
IS (6 ^ wmch outputs Lphase and quadrature baseband chrormnance 
demodulator jo n * demodulator should not be reversed on 

St *l£ bSdwid^u^e demodulated components is made sufficiently 
widTto eXe to^all of the chrominance band is included. These demodulated 
components will, of course, include cross-colour. 
In order to carry out the demodulation it is necessary to 

including "ratio counting", can be used. 

The demodulated components are remodulated (619), using the identical carriers that 
we S for demodulation, and subtracted (620) from the composite input to give a 
signal which contains only luminance. 

The two demodulated components are divided into overlapping blocks (602) and 
wSdoTedTo3) in the same way as in Figures 1 and 3. Each block xs ; apptod to a 
2^ ^ three-dimensional FFT (604), which treats the two components as real and 
m^yr parts of a complex variable. The resulting frequency components are 
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processed in the same way as described above by the blocks (605), (606), (607), (608) 
and (609) so as to identify symmetrical components and pass them to the inverse FFT 
(610). 

Because the signal has been demodulated, the horizontal frequency which 
corresponds to colour subcarrier will be zero, and so the determination of horizontal 
frequency symmetry requires the use of phase information. This is possible because 
the FFT (604) processes the signal as a complex variable. The vertical and temporal 
processing can be similar to that described above. 

The real and imaginary outputs of the inverse FFT (610) are windowed (61 1), and the 
blocks are combined (612) to give two, cross-colour free, colour difference signals 
(616). In the case of PAL, the V-axis component must be reversed on alternate lines 
because this was not done at the demodulation stage. 

This "clean" chrorninance is subtracted (613) (making due allowance for processing 
delays) from the unprocessed, demodulated chrominance to give baseband cross- 
colour. This is remodulated (621), onto the same carriers that were used for the 
demodulation, to give true luminance. This luminance is added (622) (in the correct 
phase and appropriately timed) to the output of the subtracter (620). The result is a 
cross-luminance free, full bandwidth luminance output (614). 

The decoder structure of Figure 6 may be used for PAL or NTSC, the only essential 
differences are the generation of the appropriate subcarrier for demodulation and 
remodulation, the look-up-table to separate chrorninance and luminance, and the 
alternate line phase reversal of the V-component for PAL. 

The decoders described so far have been "complementary", that is to say no input 
frequencies are lost, they are either processed in the luminance channel or the 
clnominance channel, and the sum of the chrominance and luminance frequency 
responses is unity. This ensures theoretical reversibility of the decoding process. 

If reversibility is not a requirement, it can be advantageous to optimise the 
ctoonimance and luminance responses independently of each other. Figure 7 shows a 
decoder allowing this possibility. ~ " 

Referring to Figure 7, it will be seen that there is some similarity with the decoder of 
Figure 3 (the reference numerals of corresponding functional blocks differ only in the 
first digit). The difference is that the look-up-table (708) has two outputs, one 
controlling the luminance response, and the other controlling the chrorninance 
response. There are two separate processing chains (709C to 712C, and 709Y to 
712Y), which convert the unit-amplitude frequency components from the divider 706 
to luminance and dominance signals. 

The look-up-table 708 can be considered as two separate tables with common inputs, 
one table producing a luminance amplitude control signal for the multiplier (709Y), 
and the other producing a clnorninance amplitude control signal for the multiplier 
(709C). The multipliers control the magnitudes of the frequency components input to 
respective inverse FFT stages (71 0Y) and (7 10C). 

Figure 8 shows an example of how the luminance amplitude control signal depends 
on the table inputs for a table "page" close to subcarrier frequency. Where the 
frequency component being processed is similar in amplitude to the corresponding 
"reflected" component, the output from the table is zero. Where the two frequency 
components have significantly different amplitudes, the table output corresponds to 



the amplitude of the frequency component being processed. Between these conditions 
the table output varies smoothly between these two states. This response is the 
"complement" of the response shown in Figure 4. 

Figure 9 shows the chrominance amplitude control signal for a similar region of the 
table. As the chrominance table is not constrained by the needs of the luminance 
channel/ a response which corrects for distortion of the chrominance can be 
implemented. Where the frequency component and its reflection are nearly equal in 
magnitude, the output is equal to the average of the two amplitudes, otherwise the 
response is similar to that shown in Figure 4. This averaging can eliminate the U/V 
crosstalk which results from unwanted attenuation of the upper chrominance 
sidebands by filters in the transmission chain prior to the decoder. 

Although the U/V crosstalk is eliminated the chrominance resolution is degraded. 
Figure 10 shows another chrominance look-up-table function, which restores the lost 
chrominance resolution. Here the frequency input to the table is used to determine 
whether the frequency component being processed is an upper or lower chrominance 
sideband (i.e. whether the signal frequency corresponding to the spatial frequency is 
higher or lower than that of the unmodulated subcanier frequency). When the 
frequency being processed corresponds to an upper sideband, and its amplitude is 
slightly less than that of the corresponding lower sideband, the table output 
corresponds to the amplitude of the respective lower sideband. When the frequency 
input to the table shows that a lower chrominance sideband may be being processed, a 
response as shown in Figure 4 is used. In this way the high frequency chrominance 
loss is corrected as well as the U/V crosstalk, 

A suitable method of generating the table is to "train" it as described above, using 
composite material which has suffered a range of sideband losses. 

The chrominance processing methods of Figures 9 and 10 are not appropriate for the 
decoders of Figures 3 or 6 because the modified chrominance would not cancel the 
input chrominance and cross-luminance would result. However, the decoder of 
Figure 6 can be modified to include a separate luminance path as shown in Figure 1 1 . 
Those elements of Figure 11 which correspond to "Figure 6 have been given similar 
reference numerals; the (6*) being replaced by (11*). The look-up-table (1108) has 
separate outputs to control the chrominance and luminance responses in the same way 
as the decoder of Figure 7. 

It has been explained that different frequencies can address different pages of the 
look-up-table. Other parameters can be used instead of, or as well as, frequency. 
Vertical, horizontal or temporal signal-differences can be used to determine the page 
to be used. The transform may use less than three frequency dimensions, for example 
the temporal dimension may be omitted and reliance placed upon signal-differences to 
identify movement in the image being decoded. 

It must be recognised that examples of the invention have been described here and 
that the skilled person will be able to implement it in other ways which fall within the 
concept which has been described. 
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Claims 

1. A method of separating the chrominance and luminance of a composite colour 
television signal by comparing each of a set of first frequency components of the 
signal with a respective second frequency component of the signal, each second 
component having a frequency difference from the colour subcarrier equal and 
opposite to the frequency difference from the colour subcarrier of the associated 
first frequency component, characterised in that respective comparisons differ in 
dependence upon the frequency of the first frequency component. 

2. A method according to Claim 1 in which the comparisons differ in dependence 
upon the horizontal spatial frequency of the said first frequency component. 

3. A method according to Claim 1 in which the comparisons differ in dependence 
upon the vertical spatial frequency of the said first frequency component. 

4. A method according to Claim 1 in which the comparisons differ in dependence 
upon the temporal frequency of the said first frequency component. 

5. A method according to Claim 1 in which the comparisons differ in dependence 
upon horizontal, vertical or temporal differences of a composite signal. 

6. A method according to Claim 1 in which the comparisons differ in dependence 
upon horizontal, vertical or temporal differences derived from the output of a 
chrominance demodulator. 

7. A method of separating the chrominance and luminance components of a 
composite colour television signal by comparing a first frequency component of 
the signal with a second frequency component of the signal, the second 
component having a frequency difference from the colour subcarrier equal and 
opposite to the frequency difference of the first frequency component from the 
colour subcarrier, characterised in that the comparison is made by processing 
demodulated, baseband chrominance signals. 

8. A method of decoding a composite NTSC signal according to any of the 
preceding claims. 

9. A method of decoding a composite colour television signal wherein distortion of 
the said signal is corrected characterised in that an upper chrominance sideband is 
identified and its amplitude corrected by making it equal to the amplitude of the 
corresponding lower chrominance sideband. 

10. A method according to Claim 9 in which the corresponding lower sideband is 
identified in terms of its horizontal spatial, vertical spatial and temporal 
frequency. 

11. A method of processing a television signal according to any of the preceding 
claims wherein the signal is sampled at an integer multiple of the line frequency. 
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